Critical transient in the Barabasi model of human dynamics 
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We introduce an exact probabilistic description for L = 2 of the Barabasi model for the dynamics 
of a Ust of L tasks. This permits to study the problem out of stationarity, and to solve explicitly 
the extremal limit case where a critical behavior for the waiting time distribution is observed. This 
behavior deviates at any finite time from that of the stationary state. We study also the characteristic 
relaxation time for finite time deviations from stationarity in all cases showing that it diverges in 
the extremal limit confirming that this deviations are important at all time. 

PACS numbers: 



Queueing theory is a very important branch of proba- 
bility with fundamental applications in the study of dif- 
ferent human dynamics [1]. Its capability in explaining 
and modeling complex behaviors of such activities has 
potentially important economical consequences. An ex- 
ample is the prediction and organization of "queues" in 
hi-tech communications. Queue stochastic dynamics are 
traditionally modeled as homogeneous Poisson processes 
This means that the probability to do a specific ac- 
tion in the time dt is given by qdt, where q is the overall 
activity per unit time, and there is no statistical correla- 
tion between non overlapping time intervals. As a result, 
the time interval between different events is predicted to 
be exponentially distributed. Actually, different experi- 
mental analysis 0, 0] have shown that for various human 
activities the distribution of waiting times is better fitted 
by heavy tail distributions like the power laws character- 
istic of Pareto processes. In order to reproduce such a 
behavior Barabasi [3] has introduced a simple model for 
a task list with a heavy tail distribution of waiting times 
in its stationary state and in a particular extremal limit. 
In this paper we analyze the same model out of the sta- 
tionary state introducing an exact step-by-step method 
of analysis through which we find the exact waiting time 
distribution in the same extremal limit. We show that in 
this limit the stationary state is reached so slowly that 
almost all the dynamics is described by the transient. 

In the Barabasi model the list consists at any time in 
a constant number L of tasks to execute. Each task has 
a random priority index Xi {i = 1, ...L) extracted by a 
probability density function (PDF) p{x) independently 
one of each other. The dynamical rule is the following: 
with probability < p < 1 the most urgent task (i.e. 
the task with the highest priority) is selected, while with 
complementary probability {1 — p) the selection of the 
task is done completely at random. The selected task is 
executed and removed from the list; it is then replaced 
by a fresh new task with random priority extracted again 
from p{x). For p = the selection of the task at each time 
step is completely random. Therefore the waiting time 
distribution for a given task is P{r) = (1/L)(1 — l/Ly 
and decays exponentially fast to zero with time constant 
To — For p = 1 instead the dynamics is deterministic 
selecting at each time step the task in the list with the 



highest priority. Due to this extremal nature the statistics 
of the dynamics for p = 1 does not depend on p{x). It 
has been shown 0, [H that the dynamics for < p < 1 
reaches a stationary state characterized by a waiting time 
distribution P(r) which is proportional to with a 
p— dependent upper cut-off and amplitude. For p ^ 1 
the cut-off diverges, but the amplitude vanishes, so that 
in this limit from one side criticality (i.e. divergence of the 
characteristic waiting time tq) is approached, but from 
the other P(r) looses sense due to the vanishing of its 
amplitude. From simulations this behavior does not look 
to depend on L, and the exact analytic solution for the 
stationary state has been given for L = 2 in [5|]. 

Here we propose a different approach to the problem 
for L = 2 able to give a complete description of the task 
list dynamics also out of the stationary state. In this way 
we find the exact waiting time distribution for p = 1 
which is characterized by power law tails, but with a dif- 
ferent exponent from that found in [5] for the stationary 
state. We also show that in this extremal limit the fi- 
nite time deviation from the trivial stationary state has 
diverging relaxation times. Hence the waiting time dis- 
tribution at any time is completely determined by these 
deviations and differs from the stationary one. 

The method we use here is called Run Time Statistics 
(RTS) [6] and it has been introduced originally to study 
an important model of Self Organized Criticality (SOC): 
the Invasion Percolation (IP) in dimension d = 2 [7^, Isj 
and related models [9] . For p = 1 this task list model can 
be exactly mapped in Invasion Percolation (IP) in d = 1. 
The latter has this formulation: consider a linear chain 
of throats (see FigH]), each of which is given, indepen- 
dently of the others, a random number Xi extracted from 
the PDF p{x) and representing its capillarity (which is 
inversely proportional to the diameter). At t = the in- 
vader fluid is supposed to occupy only the central throat. 
At each time step the growth interface is given by the 
two non occupied throats in contact with the invaded 
region. The invaded region grows by occupying the in- 
terface throat with the maximal capillarity (i.e. minimal 
diameter). In this way the interface is updated by elimi- 
nating from it the selected throat and including the next 
one in the direction of growth. This is exactly equivalent 
to the task list problem for p = 1 and L = 2, with the 
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FIG. 1: The figure represents the first eight time steps of IP 
dynamics in d = 1. At each time step the throat of the growth 
interface with the maximal capillarity (i.e. minimal diameter) 
is occupied by the invader fluid. The throats have random 
capillarities, i.e. random diameters and, due to the extremal 
nature of the dynamics, its statistical properties do not de- 
pend on the PDF from which capillarities are extracted. 

set of the already executed tasks given by the invaded 
region, and the task list given by the two throats of in- 
terface. Analogously the case of the task list with L > 2 
can be mapped for p = 1 into the case of IP on a star-like 
set of throats with L linear branches [10]. For < p < 1 
the task list problem would correspond to a sort of IP at 
finite temperature [11] which introduces a source of noise 
in the problem permitting random non extremal growths. 
The quantity {I — p) is a measure of such thermal noise 
which vanishes for p = 1 and becomes maximal for p = 0. 

In general for growth processes with quenched disor- 
der it is very difficult to factorize the statistical weight 
of a growth path (i.e. selection sequence) into the prod- 
uct of probabilities of the composing elementary steps. 
The problem is that these single-step probabilities de- 
pend upon all the past history of the process, i.e, dynam- 
ics in quenched disorder present usually strong memory 
effects. This feature makes very difficult to evaluate the 
statistical weight of any possible history of the process 
which is usually the elementary ingredient to perform 
averages over the possible realizations of the dynamics. 
To overcome this difficulty, RTS gives a step-by-step pro- 
cedure to write the exact evolution of the probabilities of 
the single steps conditional to the past history and the re- 
lated conditional PDF of the random variables attached 
to the growing elements ("task priorities" in this case). 
Given two tasks with respective priorities x and we 
call r]{x,y) the probability conditional to these values to 
execute the task with priority x. The form of r] is de- 
termined by the selection (i.e. growth in IP) rule of the 
model. Given the definition of the Barbasi model and 
being 0{x) the Heaviside step function, we have: 

1-p 

r]{x, y) = pO{x -y)^ . (1) 

If we now suppose that at the t^^ time-step of the se- 
lection dynamics the variables x and y are statistically 
independent and have respectively the PDFs conditional 
to the past history of the process p{x^t) and q{y^t)^ we 
can write the probability of selecting the task with pri- 
ority X conditional to the past history as 

li{t) = I / dxdyp{x,t)q{y,t)r]{x,y). (2) 
Jo Jo 

When the selection is done the selected task is removed 



from the list and replaced by a fresh new task with a 
random priority extracted from p{x). The other task re- 
mains instead in the list. We indicate the first fresh task 
with N (as "new"). The PDF of its priority conditional 
to the past history is simply p{x) as it is new. The sec- 
ond task is consequently indicated with O (as "old"), 
and we call the PDF of its priority, conditional to the 
past history of the task list, as po{x,t). For all t > 
and p > it differs from p{x). Given our particular form 
([1]) of r]{x,y), poix^t) is, for p > 0, more concentrated 
on the small values of x than p{x). At t = the ini- 
tial condition is ^0(^,0) = p{x). Since at each time-step 
the task N is new, the priorities x and y of N and O 
are statistically independent and their joint probability 
factorizes into the product p{x)po{y^t). Any realization 
of the task list (i.e. a selection path) lasting r steps can 
be represented as a time ordered string of r letters N 
and O (e.g. NONNONO....). In particular the statisti- 
cal weight of the selection path NN..N composed by r 
subsequent events N gives the probability that the wait- 
ing time of the task O, from the beginning of the list 
dynamics, is at least r. In terms of IP in d = 1 this 
path represents a growth avalanche in one single direc- 
tion starting at t = and lasting at least r steps. We can 
rewrite Eq. ([2]) for both the cases in which the task N or 
O are selected at time t: 

{ MivW = lo lo dxdy p{x)po{y,t)r]{x,y) 

[ fio{t) = I- fiN{t) = dxdypo{x,t)p{y)r]{x,y) 

(3) 

For each of this two selection events we update conse- 
quently the conditional PDFs of the priorities including 
this last step in the past history conditioning probabili- 
ties. As explained above, the conditional PDF of the new 
task replacing the selected one is p{x). Instead the condi- 
tional PDF po{x^t-\-l) at time t + 1 of the j ust unselected 
task, still in the list, is different in the two cases above. If 
the task N is selected, the task O remains O also at the 
next time-step (see Figl2j). We can use the rules of the 
conditional probability to include the last selection step 
in the "memory" of the past history: 

1 

po{x,t^l) = -—po{x,t) / dyp{y)r]{y,x) . (4) 

I^N{t) Jo 

If instead O is selected at time t, it is removed, and the 
N at time t becomes the task O at time (t + 1): 

1 

po{x,t^l) = 7T^p{x) / dypo{y,t)r]{y,x) . (5) 

The whole set of all possible selection paths can be rep- 
resented as a non-Markovian binary branching process 
whose realizations tree is represented in Fig. 2. The initial 
node (top vertex) represents the initial situation where 
one has two tasks with completely random priorities [i.e. 
distributed as p{x)]. From each node there is a bifurcation 
of possible choices: either task A/" or O is selected. There- 
fore each node of the tree represents the task list at the 
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end of the time ordered selection path connecting directly 
the top vertex with the given node and is characterized 
by path-dependent conditional PDF po and probabilities 
for the next bifurcation jun and /io- The exact statistical 
weight of each path on the tree and the conditional PDF 
Po at the end of it can be calculated by applying the 
above RTS step-by- step procedure. Therefore the RTS 
provides a complete mathematical description of the task 
list dynamics. Note that the dynamics of the task list in 
this model is a binary branching process with memory, 
in the sense that the probabilities of a configuration at a 
given time depends for p > on all the past history of 
the list. This memory effect is maximized for p = 1 when 
the list dynamics becomes deterministic and extremal. 

A very important quantity in this class of dynamics 
is the average priority "histogram" [1, [ll|, that is the 
statistical distribution of the priorities of the task list 
at a given time t averaged over all the selection paths: 
h{x,t) = [p{x) + {po{x,t))^\/2. Hence, the evolution of 
h{x^t) is directly given by that of pi{x^t) = {po{x,t))^. 
The equation for its time evolution can be found by ob- 
serving that at each binary branching starting from a 
node at time t of the tree we can say that with probabil- 
ity /iAr(t) the priority conditional PDF po{x^t) updates 
as in Eq. (|4]) and with probability po{t) as in Eq. ([5]), i.e. 

7ro{x,t^l;t) = po{x,t) / dyp{y)r]{y, x) 

Jo 

+ p{x) / dypo{y,t)r]{y,x) , 
Jo 

where 7ro{x,t-\-l;t) is the conditional PDF of the priority 
of the task O at time (t + 1) conditional to the history 
only up to time t. By applying this average from the first 
time step it is simple to show that: 

+ = pi{x,t) / dyp{y)r]{y,x) 



+ p{x) I dypi{y,t)r]{y,x) . (6) 
Jo 

This is exactly the basic equation used in ^ to study 
the task list dynamics in the stationary state, i.e., when 
pi{x^t-\-l) = pi{x,t). We show in the following that how- 
ever in the limit p ^ 1 the stationary state is reached 
only very slowly and that the waiting time distribution 
is determined by the finite time deviation from the sta- 
tionary state at all time. This waiting time distribution 
is again a power law, but with a different exponent with 
respect to that found in [5]. We now solve exactly the 
RTS for the case p = 1. For our calculation we use here 
p{x) = 1 for x G [0, 1] as in J5|] because the path statistics, 
as aforementioned, does not depend on p{x) for p = 1. 
Hence Eqs. (j3]) above takes the simple form: 

MatW = Io (1 - x)p''o{x,t) 
Poifil = Pyifil = Jq dxxp^o{x,t) , 
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FIG. 2: Tree representation of all the possible selection paths 
(i.e. realizations of the dynamics). At each time step either 
the fresh new task (N) either the old one (O) is selected. In 
general for p > po{x,t) ai the end of a path depend on the 
specific path. Only for p — 1, when information on priorities 
and memory are maximal, po{x,t) is the same for all paths. 



where the superscript "e" stands for "extremal" . Analo- 
gously Eqs. dl]) and ([5]) for p = 1 read respectively 



+ 1) 



{l-x)p^o{x,t) 



1 

t + 1) = J dxp'oix, t) . 

using Pq(x,0) = p{x) in the above equations, one finds 
that, for any selection path, Pq and Pq becomes: 



(7) 
(8) 



Since Po{x^t) is independent of the considered path, 
pi{x^t) for p = 1 coincides with it. Note that py{t^ 
oo) ^1 and pi{x^t) = pQ^x^t^oo) — 0+) [where 

5{x) is the Dirac delta function], i.e., in the infinite time 
limit the new fresh task is always selected as the old 
one has vanishing priority with probability one. The fact 
that both the /i^'s and the p^'s at time t are the same for 
each selection path of length t is a feature of the p = 1 
case. This is not the case for < p < 1 where instead 
the conditional selection probability and priority PDFs 
at time t depend on which specific selection path is con- 
sidered. We now analyze the consequences of Eq. ([7j). It 
permits to find the waiting time distribution of a given 
task entered the list at time t^. From Eq. ([7j) we find 
that for p = 1 the waiting time is r = with probability 
P(r = 0;to) = (to + I) /(to + 2). The probability that it 
is still waiting after r > 1 steps, i.e. at time to + r, is: 



to + 2 3^ to + t' + 2 to + r + r 

which is the probability of the path ONN...N with one 
O event at to and (r — 1) subsequent N events. Hence 
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the probability that the waiting time is exactly t > 1 is p ^ 1 the PDF p[^\x) 5(x-0~^) and it coincides with 



WiT;to) 1 

to + T + 2 {to+T+l){to+T + 2) 



, (9) 



which is the statistical weight of the selection path 
ONN...NO with one O event at to, (r — 1) subsequent 
N events and a final O event. Note that this corresponds 
in IP to the statistical weight of an avalanche starting 
a time to and lasting r steps. The probability P(r;to) 
decreases as for r to (a behavior confirmed by 
numerical simulations). Therefore the waiting time dis- 
tribution for a task entered at time to is normalizable 
in r, but with diverging mean value. This behavior is 
different from the power law P(t) ~ found in ^] 
for the stationary state for < p < 1, which however 
disappears for p ^ 1~ as its amplitude vanishes in this 
limit. For the opposite limit to ^ r 1 one can write 
P(r; to) — tg ^(1 — 2r/to), which decreases as tg ^ with to- 
This gives the rate of approach in the initial time to to 
the trivial stationary state P(r; to oo) = 1 or respec- 
tively if r = or r > 1. This rate is very slow and there 
is no characteristic time after which one can say that the 
stationary state is attained in terms of r dependence. 

In order to study more in detail the approach to the 
stationary state for all p and for p ^ 1 , we analyze Eq. (j6|) 
out of the stationary state. First of all we rewrite this 
equation using the explicit form ([!]) of rjix^y) for this 
model and p{x) = 1 for x G [0, 1]: 



pi(x,t + 1) = pi{x,t) 



p(l - x) + 



1 — p 



p / dypi{y,t) 



2 

1-p 



(10) 



We now put pi(x,t) = Pi^\x) + Spi{x^t) , where p[^\x) 
is the stationary solution found in Eq. (4) of [5]: 



l + p 



(11) 



1-p [1 + 1^^]' 

and Spi{x,t) is the finite time deviation from it. For 



Eq. ([8]) for t ^ oo. Since t) and p[^\x) are both nor- 
malized to unity, we have dx5pi{x^t) = 0. Therefore 

as a first order approximation we put dy Spi{y^t) o:^ 
—xSpi{x^t). Taking also the continuous time approxima- 
tion [Spi{x^t + 1) — 5pi{x^t)] dSpi{x,t)/dt^ we can 
rewrite Eq. (p!Q|) in terms of Spi{x^t) as 



dSpi{x^ t) 
Jt 



2px ) Spi{x^ t) . 



(12) 



Hence Spi{x,t) decays exponentially in time with an 
X— dependent time constant inversely proportional to 
[(1 — p)/2 + 2px]. For p < 1, at each x the perturba- 
tion decays exponentially fast and the stationary state 
is attained, while for p ^ 1 the time constants becomes 
proportional to 1/x and the perturbation in the region 
around x = relaxes very slowly. But from Eq. (pT]) it 
is exactly in this region that for p ^ 1 all the measure 
p^*^(x) is concentrated. This confirms our previous con- 
clusion that for p ^ 1 the stationary state is very slowly 
attained and finite time deviation from it play a funda- 
mental role in determining the rate of decrease of the 
waiting time distribution. 

In this paper we have studied an interesting queue- 
ing model of task list dynamics introduced by Barabasi. 
Through a statistical method called RTS, we are able to 
give a complete probabilistic description of the dynamics 
even out of stationarity. We find that for < p < 1 finite 
time deviations from stationarity relaxes exponentially 
fast and, consequently, the dynamics is well described by 
the stationary state. However for p ^ 1 the stationary 
state becomes trivial and finite time deviations relaxes 
so slowly that the task list dynamics has to be described 
as an intrinsically non stationary dynamics. This is char- 
acterized by power law waiting time distributions with 
a characteristic exponent which is different from the one 
found [5] in the stationary state for < p < 1. 
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